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Compiler for Multiple Processor and Distributed Memory Architectures 

Field of the Invention 

[0001] The invention relates to compilers and methods of compiling high-level 
languages. In particular, the invention relates to methods and apparatus for mapping a 
high-level language description of an embedded system into a hardware architecture of a 
custom integrated circuit. 

Background of the Invention 

[0002] Custom integrated circuits are widely used in modern electronic equipment. 
The demand for custom integrated circuits is rapidly increasing because of the dramatic 
growth in the demand for highly specific consumer electronics and a trend towards 
increased product functionality. Also, the use of custom integrated circuits is 
advantageous because custom circuits reduce system complexity and, therefore, lower 
manufacturing costs, increase reliability and increase system performance. 

[0003] There are numerous types of custom integrated circuits. One type consists of 
programmable logic devices (PLDs), including field programmable gate arrays (FPGAs). 
FPGAs are designed to be programmed by the end designer using special-purpose 
equipment. PLDs are, however, undesirable for many applications because they operate 
at relatively slow speeds, have a relatively low integration, and have relatively high cost 
per chip. 



[0004] Another type of custom integrated circuit is an application-specific integrated 
circuit (ASIC). Gate-array based and cell-based ASICs are often referred to as "semi- 
custom" ASICs. Semi-custom ASICs are programmed by either defining the placement 
and interconnection of a collection of predefined logic cells which are used to create a 
5 mask for manufacturing the integrated circuit (cell-based) or defining the final metal 
interconnection layers to lay over a predefined pattern of transistors on the silicon (gate- 
array-based). Semi-custom ASICs can achieve high performance and high integration 
but can be undesirable because they have relatively high design costs, have relatively 
long design cycles (the time it takes to transform a defined functionality into a mask), and 
H 10 relatively low predictability of integrating into an overall electronic system. 
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[0005] Another type of custom integrated circuit is referred to as application-specific 
standard parts (ASSPs), which are non-programmable integrated circuits that are 
P designed for specific applications. These devices are typically purchased off-the-shelf 

yi. 

jp&- from integrated circuit suppliers. ASSPs have predetermined architectures and input and 

(U 

Ifl 1 5 output interfaces. They are typically designed for specific products and, therefore, have 

ft 

short product lifetimes. 

[0006] Yet another type of custom integrated circuit is referred to as a software-only 
architecture. This type of custom integrated circuit uses a general-purpose processor and 
a high-level language compiler. The designer programs the desired functions with a 
20 high-level language. The compiler generates the machine code that instructs the 

processor to perform the desired functions. Software-only designs typically use general- 
purpose hardware to perform the desired functions and, therefore, have relatively poor 
performance because the hardware is not optimized to perform the desired functions. 



[0007] A relatively new type of custom integrated circuit uses a configurable . 
processor architecture. Configurable processor architectures allow a designer to rapidly 
add custom logic to a circuit. Configurable processor circuits have relatively high 
performance and provide rapid time-to-market. There are two major types of 
5 configurable processors circuits. One type of configurable processor circuit uses 

configurable Reduced Instruction-Set Computing (RISC) processor architectures. The 
other type of configurable processors circuit uses configurable Very Long Instruction 
Word (VLIW) processor architectures. 

[0008] RISC processor architectures reduce the width of the instruction words to 



P 10 increase performance. Configurable RISC processor architectures provide the ability to 
jy introduce custom instructions into a RISC processor in order to accelerate common 
Hj operations. Some configurable RISC processor circuits include custom logic for these 

i§ 

operations that is added into the sequential data path of the processor. Configurable 



RISC processor circuits have a modest incremental improvement in performance relative 



[0009] The improved performance of configurable RISC processor circuits relative to 
ASIC circuits is achieved by converting operations that take multiple RISC instructions 
to execute and reducing them to a single operation. However, the incremental 
performance improvements achieved with configurable RISC processor circuits are far 
20 less than that of custom circuits that use custom logic blocks to produce parallel data 



[0010] VLIW processor architectures increase the width of the instruction words to 




P. 15 to non-configurable RISC processors circuits. 
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flow. 
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increase performance. Configurable VLIW processor architectures provide the ability to 
use parallel execution of operations. Configurable VLIW processor architectures are 
used in some state-of-the art Digital Signal Processing (DSP) circuits. These known 
configurable VLIW processor architectures are single processor architectures and 
5 typically require a relatively large amount of memory. The ability to add custom logic 
units in such configurable VLIW processor architectures is limited to adding custom 
logic units in predefined locations in the data path. 

[0011] Known configurable VLIW processor architectures are difficult to support with 
high-level language compilers and difficult to design with known compilers. These 
10 compilers are relatively complex. Configurability is typically achieved by custom 
assembly language programming. Using assembly language programming is more 
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h j difficult and time consuming and, therefore increases the time-to-market and the cost of 
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^ goods using such processors. 

P 

pj Summary of the Invention 

iff 

fU" 1 5 [0012] A compiler for multiple processor and distributed memory architectures 

according to the present invention uses a high-level language to represent the task-level 
network of behaviors that describes an embedded system. Using a high-level 
programming language allows the designer to code an intuitive network of tasks that are 
related through control and data flow connections. The compiler can directly map a task- 
20 level network of behaviors onto a multiple processor and distributed memory hardware 
architecture. 

[0013] A compiler and method of compiling according to the present invention is 
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independent of the number of processors and independent of the number of shared and 
private data memory resources. A compiler according to the present invention can be 
highly automated and can efficiently automate mapping tasks onto binary code that can 
be executed on a physical architecture. 

5 [0014] Thus, in one aspect, the invention is embodied in a method of mapping a 
plurality of tasks and data onto a multiple processor, distributed memory hardware 
architecture. The method includes describing a task-level network of behaviors. Each of 
the task-level network of behaviors is related through control and data flow. 

H* [0015] The method also includes predicting a schedule of tasks for the task-level 
B 10 network of behaviors. In one embodiment, the predicting includes minimizing an 

M execution time for the plurality of tasks. In one embodiment, the predicting includes 

n 
HI 

m minimizing the schedule of tasks by allocating data to the distributed memories in order 

f 

p| to minimize data transfers. In one embodiment, the predicting includes maximizing 



fjj parallel execution of the plurality of tasks on at least two processors of the multiple 

I • 

1 5 processors. In one embodiment, the predicting the schedule of tasks includes using a 
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resource-based model of the hardware architecture to predict the schedule of tasks. In yet 
another embodiment, the predicting includes using an interval graph and an execution 
time model of the task-level network of behaviors to predict the schedule of tasks. 

[0016] The method further includes allocating the plurality of tasks and data to at least 
20 one of the multiple processors and to at least one of distributed memory, respectively, in 
response to the predicted schedule of tasks. In one embodiment, the allocation includes 
allocating tasks to one of the multiple processors that has optimal processor resources for 
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the tasks. In one embodiment, the allocation of the plurality of tasks and data includes an 
iterative allocation process that uses a demand-driven and constraint-based objective 
function to determine the allocation. In one embodiment, the allocation of the plurality of 
data to the distributed memories includes allocating data to shared memories. In another 
5 embodiment, the allocation of the plurality of data to the distributed memories includes 
allocating data to private memories. 

[0017] In one embodiment, the description of the task-level network of behaviors 
includes describing a task-level network of behaviors in a high-level programming 
language. In one embodiment, the description of the task-level network of behaviors in 
1 0 the high-level programming language includes parsing the high-level programming 

language into an intermediate form. In one embodiment, the method includes generating 
machine executable code for the multiple processor, distributed memory hardware 
architecture based at least in part on allocating the plurality of tasks and data. 

[0018] In another aspect, the invention is embodied in a method for generating a 
1 5 control graph for a compiler used to map a plurality of tasks and data onto a multiple 
processor, distributed memory hardware architecture. The method includes parsing a 
plurality of tasks into an internal compiler form of interconnected task nodes. A compiler 
representation is then linked to each interconnected task node using directed edges for the 
purpose of substantially simultaneously mapping the tasks to multiple processors in the 
20 multiple processor, distributed memory hardware architecture. 

[0019] In one embodiment, the method further includes binding the interconnected 
task nodes to the directed edges. In one embodiment, the method includes parsing a 
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plurality of data blocks into an internal compiler form of data nodes and linking a 
compiler representation to each data node using directed edges. The directed edges can 
represent time intervals. The time intervals can include the period between tasks, the 
time period from beginning a task to ending a task, or a set time period. In one 
5 embodiment, the time interval includes a time period between time periods. 

[0020] In another aspect, the invention is embodied in a method for executing a 
schedule of tasks in a multiple processor, distributed memory architecture. The method 
includes generating the schedule of tasks based at least in part on a task-level network of 
behaviors. 



D 1 0 f 00211 A demand function is calculated based at least in part on a constraint related to 
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*jj at least one of a plurality of tasks in the schedule of tasks. In one embodiment, the 
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Lj demand function can be calculated based at least in part on the task-level network of 

p behaviors. In one embodiment, the demand function is calculated based at least in part 
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fU on an impact on the schedule of tasks. In one embodiment, the demand function is 

1 5 calculated based at least in part on an impact on data movement. In one embodiment, the 
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demand function is calculated based at least in part on prior allocation decisions. 

[0022] The method further includes allocating a task having highest priority to a 
processor having the least cost according to the demand function. In one embodiment, 
the cost is defined as the least negative impact on at least one performance factor. The 
20 performance factor can include the schedule of tasks or data movement. 

[0023] In one embodiment, the method includes allocating a data block to a memory 
in the distributed memory. In still one embodiment, the method includes allocating a task 
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having next highest priority to a processor having next least cost according to the demand 
function. In yet another embodiment, the method further includes recalculating the 
demand function in response to each task in the plurality of tasks being allocated to a 
processor. 

5 Brief Description of the Drawings 

[0024] The above and further advantages of this invention may be better understood 
by referring to the following description in conjunction with the accompanying drawings, 
in which like numerals indicate like structural elements and features in various figures, 
fa The drawings are not necessarily to scale, emphasis instead being placed upon illustrating 

s 

1 0 the principles of the invention. 
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[0025] FIG. 1 illustrates a schematic block diagram of a multi-processor hardware 
architecture that includes a plurality of task processors that are in communication with a 
plurality of distributed shared memories, where each of the plurality of shared memory 
connects to a maximum of two task processors according to the present invention. 

1 5 [0026] FIG. 2 illustrates a schematic block diagram of a multi-processor hardware 
architecture that includes a plurality of task processors that are in communication with a 
plurality of distributed shared memories, where each of the plurality of shared memory 
connects to a maximum of three task processors according to the present invention. 

[0027] FIG. 3 illustrates a schematic block diagram of a multi-processor hardware 
20 architecture that includes a plurality of task processors that are in communication with a 
plurality of distributed shared memories, where each of the plurality of shared memory 
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connects to N task processors according to the present invention. 

[0028] FIG. 4 illustrates a control data-flow task graph according to a method of 
compiling according to the present invention. 

[0029] FIG. 5 illustrates a control data flow task graph describing an example of the 
5 execution of a schedule of tasks according to the invention. 

[0030] FIG. 6. illustrates an example of an estimated time model and a statistical time 
model according to the invention. 

|* [0031] FIG. 7 illustrates an interval graph according to the method of the present 
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■Sl 10 [0032] FIG. 8 illustrates an example of a schedule for determining an order for which 

P 

55 tasks execute according to the invention. 
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y [0033] FIG. 9 is a flowchart illustrating the association of data records with available 
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m data memory within the multiprocessor architecture according to the invention. 



[0034] FIG. 10 is a flowchart illustrating an example of task and data prioritization 
1 5 and allocation in accordance with the present invention. 

Detailed Description 

[0035] A compiler according to the present invention can be used to map a high-level 
language program that represents a task-level network of behaviors that describes an 
embedded system onto a multiple processor and distributed memory hardware 
20 architecture. Such an architecture is described in co-pending U.S. patent application 



serial number 09/480,087 entitled "Designer Configurable Multi-Processor System/' filed 
on January 10, 2000, which is assigned to the present assignee. The entire disclosure of 
U.S. patent application serial number 09/480,087 is incorporated herein by reference. 

[0036] Referring more particularly to the figures, FIG. 1 illustrates a schematic block 
5 diagram of a multi-processor architecture 10 that includes a plurality of task engines or 
task processors 12 that are in communication with a plurality of distributed shared 
memories 14. The task processors 12 are connected in a linear architecture. Each shared 
memory 14 connects to at most two of the plurality of task processors 12. 

!■* [0037] The plurality of task processors 12 is in communication with a task queue bus 
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jS 10 (Q-Bus) 16. The Q-bus 16 is a global bus for communicating on-chip task and control 

, .1 information between the plurality of processor task processors 12. Each task processor 

P 1 2 includes a task queue 1 8 that communicates with the task queue bus 1 6. The task 

$ 

S3 queue 1 8 includes a stack, such as a FIFO stack, that stores tasks to be executed by the 

I* 

lU task processor 12. The plurality of distributed shared memories 14 are in communication 

I 

C| 1 5 with the plurality of task processors 12. Each of the plurality of distributed shared 

memories 14 is connected to a maximum of two of the plurality of task processors 12. 

[0038] FIG. 2 illustrates a schematic block diagram of a multi-processor hardware 
architecture 50 that includes a plurality of task processors 12 that are in communication 
with a plurality of distributed shared memories 14. Each of the plurality of distributed 
20 shared memories 14 connects to a maximum of three of the plurality of task processors 
12 according to the present invention. 

[0039] The architecture 50 of FIG. 2 is similar to the architecture 1 0 of FIG. 1 . Each 
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of the plurality of processors 12 is connected in a linear architecture. The plurality of 
task processors 12 are in communication with a task queue bus (Q-Bus) 16, which is a 
global bus for communicating on-chip task and control information between the each of 
the plurality of task processors 12. 

[0040] The plurality of distributed shared memories 14 are in communication with the 
plurality of task processors 12. Each of the plurality of distributed shared memories 14 is 
connected to a maximum of three of the plurality of task processors 12. The architecture 
50 of FIG. 2 has some advantages in comparison to the architecture 10 of FIG. 1. The 
greater number of processor connections to each of the plurality of shared memories 14 
increases the number of possible multi-processor architecture topologies and, therefore, 
the flexibility of the architecture. Increasing the number of processor connections to 
shared memories 14, however, may lower the maximum obtainable clock rate of the 
architecture. 

[0041] FIG. 3 illustrates a schematic block diagram of a multi-processor hardware 
architecture 100 that includes a plurality of task processors 12 that are in communication 
with a plurality of distributed shared memories 14. Each of the plurality of distributed 
shared memory 14 connects to N task processors 12 according to the present invention. 
The architecture 100 is a generalized multi-processor architecture, where any number of 
task processors 12 can be connected to one global distributed shared memory 14. 

[0042] The architecture 100 of FIG. 3 is similar to the architectures 10 of FIG. 1 and 
50 of FIG. 2. Each of the plurality of task processors 12 is connected in a linear 
architecture. The plurality of task processors 12 are in communication with a task queue 
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bus (Q-Bus) 16. The plurality of distributed shared memories 14 are in communication 
with the plurality of task processors 12. Each of the plurality of shared memories is 
connected to N task processors 12. This architecture 100 has numerous flexible multi- 
processor architecture topologies because of the unlimited number of processor 
5 connections to each of the plurality of shared memories 14. 

[0043] A compiler that implements a method according to the present invention 
generates object code for the multi-processor architectures 10, 50, and 100 of FIGs. 1 
though 3, respectively. The compiler generates code for multi-processor architectures 10, 
50, and 100 having any number of task processors 12 and any number of distributed 

9 1 0 shared memories 14 that are in communication the task processors 12. 

O 

m 

[0044] FIG. 4 illustrates a control data-flow task graph 150 according to the present 
m invention. By control data-flow graph we mean a graph that represents the flow of a 
P program including the interrelated task and data dependencies. The control data-flow 
HI graph 150 is also referred to as an intermediate compiler representation. The control 

i 

B 1 5 data-flow graph 1 50 uses a hardware architectural model as the target. The target is a 
representation of the task processors 12 (FIG. 3) being targeted. For example, the 
architectural model contains resource information corresponding to each task processor 
12 in the plurality of task processors. The resource information can include information 
about computational units, size of memories, width of registers, etc. The tasks are parsed 
20 into an internal compiler form of nodes 152. Internal compiler forms of nodes 152 are 
schematic representations of program parts or program sections. Some nodes are task 
nodes 152' that represent tasks. Other nodes are data nodes 152" that represent data 
blocks. 
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[0045] The task nodes 1 52' are interconnected with directed edges 1 54 that represent a 
specific order of events. Directed edges represent a connection between two nodes of a 
directed graph. By graph we mean a set of nodes and a relationship between the nodes. 
In a directed graph, an edge goes from one node to another and hence makes a connection 
in only one direction. A directed graph is a graph whose edges are ordered pairs of 
nodes. That is, each edge can be followed from one node to the next node. In one 
embodiment, the method uses a directed acyclic graph. Directed acyclic graphs are 
directed graphs where the paths do not start and end at the same node. 

[0046] A compiler representation is linked or associated with to each task node 1 52' . 
1? 1 0 The compiler representations are abstract syntax trees representing executable behaviors 
!{j that are specified in procedural programming semantics code. The compiler associates 
the code with available program memory within the hardware architecture. A set of 
variable symbols is linked to each data node 152". The variable symbols are static 
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' H variables in the program. In one embodiment, the variable symbols can be an array, for 

W; 

|1 15 example. The variable symbols are specified as data records in the programming 
^ language. In one embodiment, the programming language. is an object oriented 
programming language, such as JAVA, for example. 

[0047] In one embodiment, an execution schedule of tasks is predicted. The execution 
schedule is predicted using a time model. For example, a prediction of the amount of 
20 time to execute each task can be used in the time model. In addition, a prediction of the 
order in which each task should execute can also be used in the time model. In one 
embodiment, the compiler minimizes the predicted execution schedule of tasks in the task 
graph 150. The compiler can minimize the predicted execution schedule in numerous 
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ways. For example, the compiler can minimize the predicted execution schedule by 
allocating tasks to the processors in order to achieve maximum parallelism. By 
parallelism we mean executing more than one task in parallel. 

[0048] FIG. 5 illustrates a control data flow task graph describing an example of the 
execution of a schedule of tasks according to the invention. The tasks are parsed into an 
internal compiler form of nodes 252. The control graph 200 includes the task nodes 252'. 
The task nodes 252' are related through the directed edges 254. Tasks are assigned to a 
first 260 and a second processor 262. The first 260 and second processor 262 are 
represented by rows of tasks. In this example, the task A and task B are assigned to the 
first processor 260. Task C is then assigned to the second processor 262. Task D, which 
is associated with task B and task C is assigned to the first processor 260. In addition, 
task E is assigned to the first processor 260 and task F is assigned to the second processor 
262. Task G is then assigned to the second processor 262. Task H is then assigned to the 
second processor 226. In this example, the control graph 200 then iterated a second time 
264. 

[0049] In one embodiment, the compiler can minimize the predicted execution 
schedule by allocating tasks to processors that allow optimal use of execution resources 
on the processor. In addition, the compiler can minimize the predicted execution 
schedule by allocating data to specific memories that minimize data transfers. In another 
embodiment, the compiler minimizes the predicted execution schedule by choosing the 
processor that has the appropriate computational units. For example, a task can execute 
more efficiently on a processor having optimized computational units. Thus, if a task 
requires many multiplying operations, the compiler can assign a processor that contains 
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an adequate number of multipliers to handle the task. 

[0050] In one embodiment, the compiler determines an estimate of the run time by 
counting the number of predicted instructions that are expected in the task body or 
program section. The task body is the behavioral code that corresponds to a specific task. 
The compiler can also determine an estimate of minimum, maximum, or average 
expected run-time. For example, in a program snippet containing an "IF, ELSE" 
statement, if the body of the "IF" statement is relatively long and the body of the "ELSE" 
statement is relatively short, the compiler can estimate that the run-time of the "IF" 
statement is longer than the run-time of the "ELSE" statement. Based on these estimates, 
the compiler can compute an average run-time for this program snippet. 

[0051] FIG. 6. illustrates an example of an estimated time model 300 and a statistical 
time model 302 according to the invention. The time models 300, 302 are representative 
of the task A 304. The task A 304 includes an associated code section 306. In one 
embodiment, the associated code section 306 includes individual program blocks 308, 
310, and 312. The program blocks 308, 310, and 312 have an estimated run-time 
associated with them. For example, the estimated run-time for the program block 308 
may be 5000 cycles, the estimated run-time for the program block 310 may be 1000 
cycles, and the estimated run-time for the program block 312 may be 200 cycles. In this 
example, the maximum number of estimated cycles the code section 306 takes to execute 
is 6000 cycles and the minimum number of estimated cycles the code section 306 takes to 
execute is 5200 cycles. Hence, the average number of estimated cycles the code section 
306 takes to execute is 5600 cycles. 
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[0052] In another embodiment, the method can measure run-time determined by a 
profiling simulation of the system in a typical execution scenario. In yet another 
embodiment, the profiling simulation is a second-time-around compilation. By second- 
time-around compilation, we mean the compiler compiles and then executes the program, 

5 thereby generating simulator run-times. In one embodiment, the profiling simulation 
generates information such as how long each program section takes to execute and how 
often each program section is executed. The profiling generates statistics that are used in 
a time-based model of the program. The profiling statistics are used in the subsequent 
compilations. In another embodiment, further measured run-time statistics can be 

1 0 retained and used as another more accurate time based model. 

[0053] Referring to FIG. 6, the statistical time model 302 illustrates three simulated 
run-times of the task A 304. In the first running simulation 314, the task A 304 takes 
4000 cycles to execute. In the second running simulation 316, the task A 304 takes 900 
cycles to execute. In the third running simulation 3 1 8, the task A 304 takes 2000 cycles 
1 5 to execute. Hence, the average statistical run-time for task A is 2300 cycles. 

[0054] In one embodiment, the compiler performs constraint-oriented and demand- 
driven scheduling. By constraint-oriented, we mean the program can include constraints 
that are required by the program prior to compilation. For example, a user may require 
that a specific piece of data be available to a specific memory at a specific address. The 
20 compiler is said to be constrained by this information, because the user specified this 

requirement in the program. In alternate embodiments, the scheduling determined during 
compilation respects constraints of tasks requiring specific hardware resources, such as 
special purpose processors. The scheduling determined during compilation also respects 
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user constraints on the placement of data and/or tasks. 

[0055] Demand-driven refers to the objective that the allocation algorithm utilizes for 
the scheduling. As each node is allocated, a demand is placed on each subsequently 
allocated node because the cost associated with each subsequent node increases. Thus, 
5 the cost associated with each node is encapsulated in a demand function. 

[0056] FIG. 7 illustrates an interval graph 400 according to the method of the present 
invention. The interval graph 400 is represented in a time domain and corresponds to the 
control graph 402. In the interval graph 400, edges 404 indicate time intervals and nodes 
406 indicate points in time. The edges 404 can represent any time interval. That is, the 
1 0 edges 404 can represent a time interval between tasks or a time interval from the 

beginning of a task to the end of a task. The edges 404 can have a specific length of time 
associated with them. The edges 404 can also represent a maximum amount of time. In 
addition, the edges 404 can represent a time order between two nodes 406 (i.e., between 
two time points). 

1 5 [0057] In one embodiment, a method according to the present invention begins by 
generating a maximum interval graph. The maximum interval graph is generated based 
on the resources available in the target configuration. For example, if four processors are 
available, the method starts with four edges that represent intervals. Any constraints are 
then applied to the graph. This causes the graph to change dynamically because the 

20 constraints require that some points in time cannot change. Thus, when a new moment in 
time is represented, a new edge must be added to the interval graph. 

[0058] A compiler according to the present invention generates the interval graph 400 
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from the control graph 402. Time intervals 404 in the interval graph 400 represent 
directed edges 408 in the control graph 402. Time points 406 in the interval graph 400 
represent nodes 410 in the control graph 402. The interval graph 400 represents 
maximally parallel execution of tasks, assuming an infinite number of resources. By 
5 infinite number of resources we mean that desired resources are always available. 

[0059] Numerous time models for the compiler may be used to represent the run-time 
of each time interval 404 or time point 406 in the interval graph 400. For example, one 
time model determines the run time by counting the number of predicted instructions that 
are expected in the task body. This estimate can include characterizations such as 
1 0 minimum, maximum, or average expected run-time. Another time model of the compiler 



U J determines the run time by a profiling simulation of the system in a typical execution 
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scenario. The simulated run-time statistics can be retained and used as the time model. 

[0060] A compiler implementing the method binds the nodes 410 in the control graph 
402 to the edges 408 or time intervals 404 in the interval graph 400 by an allocation step. 
15 Allocation can be performed in numerous ways. In one embodiment, the compiler 
performs allocation by first analyzing constraints of the control graph 402 and then 
embedding the constraint to a node 410 on the control graph 402. A maximally parallel 
interval graph 400 is then constructed, assuming infinite resources. 

[0061] A demand function is then calculated based on numerous factors that may 
20 include graph constraints, impact on the schedule, impact on the data movement, effect of 
previous allocation decisions, the estimated run-time of a task, and the estimated 
computing resources needed by a task. Skilled artisans will appreciate that many other 
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factors can also be used. The demand function is a weighted sum of these factors. The 
weights represent the importance of each factor. The effect of previous allocation 
decisions may include control neighbor assignment and data neighbor assignment. For 
example, the demand function may be a weighted sum of constraints (C), schedule (S), 
5 data movement (D), control neighbor assigned (CN), data neighbor assigned (DN), the 
estimated run-time of a task (RT), and the estimated computing resources needed by a 
task (CR). In this example, the objective (O) is equal to the following demand function: 

0= C*W1 + S*W2 + D* W3 + CN*W4 + DN*W5 + RT*W6 + CR*W7 

H 5 [0062] The weights, Wl through W7 5 are reflective of the "importance" of each factor. 
*% 1 0 Their exact values can be determined empirically by experimentation. In one 
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embodiment, each weight is an order of magnitude different from the other weights. In 
one example, the weights are as follows: Wl=1000000.00, W2=100000.00, W3=10.0, 
P W4=l .0, W5=l 00.0, W6=0. 1 , and W7=0.0 1 . Each node can be evaluated at a specific 

fU time using the demand function. At each point in the allocation, the demand function can 

jfl". 

B 1 5 be calculated for the node. At each decision in the allocation, the demand functions are 

fU 

re-computed for each node. The next node to be allocated is based on the re-calculated 
demand functions. In one embodiment, the next node is the node having the most 
demand at a certain point in time. After the next allocation is made, the demand function 
is re-computed for the remaining nodes. The node with the next highest demand is 
20 allocated next. This iteration continues until all of the nodes are allocated. 

[0063] The task with the highest demand is allocated to a processor with the least cost. 
By cost, we mean the least negative impact on performance factors, such as schedule and 
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data movement. One metric for cost is a weighted sum of the impact on the schedule and 
the impact on data movement. After the task is allocated, the interval graph 400 is 
updated with the appropriate dependencies, such as precedence edges indicating that a 
task will execute prior to another. The precedence edges do not represent time intervals, 
but instead represent a precedence or an order. 

[0064] The compiler allocates any data connected to the task to shared or private 
memories. In one embodiment, the compiler allocates data in a progressive manner. In 
this embodiment, the compiler allocates a control node and then the data associated with 
the control node is allocated. For example, if a task node is bound to a specific processor, 
the data associated with that task node must be allocated to one of the data memories 
associated with that specific processor. The compiler then progressively makes the 
decision as to which data memory to use. The decision depends on other decisions, and 
the decisions narrow as more decisions are made. A data element is allocated to as many 
resources as possible until other allocation decisions refine the number of resources to 
which it can be allocated. 

[0065] In another embodiment, the allocation algorithm progressively allocates data 
based on the allocation of tasks. Once a task is allocated to a processor, its connected 
data is 'softly' allocated to all the data memories connected to the processor. As other 
tasks are allocated, the choices for the allocation of the data become 'firmer'. Once all 
the tasks are allocated, a 'hard' choice is made for the allocation of the data to a specific 
memory. 

[0066] The method is repeated until all the tasks have been assigned to processors and 
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data has been assigned to shared and private memories. A new demand function is 
calculated based the above factors. A new order of allocation is then determined from the 
new demand function. The remaining tasks with the highest demand are allocated to the 
processor with the least cost, as described above. After the new tasks are allocated, the 
5 interval graph 400 is updated with the appropriate dependencies, such as precedence 
edges indicating task priority. Any data connected to the task is then allocated to shared 
or private memories. The data elements are allocated to as many resources as possible 
until they are 'firmly' allocated to specific resources as described above. 

[0067] FIG. 8 illustrates an example of a schedule 500 for determining an order for 
S 10 which tasks execute according to the invention. In one embodiment, the tasks in the 

IKM* 

jjjj control graph 502 are associated with intervals in the interval graph 504. For example, 

*y 

|y the task A 506 is associated with the interval 508. The task B 5 10 is associated with the 

(S 

interval 512. The task C 514 is associated with the interval 516. The task D 518 is 
associated with the interval 520. The task E 522 is associated with the interval 524. The 
P 1 5 task F 526 is associated with the interval 526. 

fit 

[0068] In one embodiment, the allocation of task node in the schedule proceeds as 
follows. During allocation, the method of the invention binds a task node 506 from the 
control graph 502 to the interval 508 in the interval graph 504. Thus, the task node 506 is 
expected to execute at the interval 508. Each node in the control graph 502 is bound by 
20 the edges in the interval graph 504. The binding process associates a task node to an 

interval. As task nodes are bound to intervals in the interval graph 504, the interval graph 
504 dynamically changes. In another embodiment, additional intervals can be added to 
the interval graph 504, further changing the interval graph 504. Once the interval graph 
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504 is completely bound to the control graph 502, a full schedule is created. 

[0069] FIG. 9 is a flowchart 600 illustrating the association of data records with 
available data memory within the multiprocessor architecture according to the invention. 
Specifically, FIG. 9 shows the control data-flow graph 602 and a partial illustration of the 
target architecture 604 having three memories. The control data-flow graph 602 includes 
the data block illustrated as DATA1 606. The data block DATA1 606 is associated with 
the shared memory 608. The data block DATA2 610 is also associated with the shared 
memory 608. The data block DATA3 612 is associated with the private memory 614. 

[0070] FIG. 1 0 is a flowchart 700 illustrating an example of task and data 
prioritization and allocation in accordance with the present invention. The control graph 
702 includes task node A 704 and task node B 706. The task A 704 and the task B 706 
are passed through the demand pipe 708 based on the demand function. The task A 704 
and the task B 706 are then allocated to the processor uTE2 710. The task E 712 is 
allocated to the processor uTEl 714. The data Dl 716 and the data D2 718 are allocated 
'softly' to many memories and then eventually 'hard' to specific memories (e.g., SM2, 
SM3, private memories, etc.). 

[0071] In one embodiment, the procedural-level representation of the tasks is 
individually analyzed after all the tasks have been assigned to processors and data has 
been assigned to shared and private memories. In one embodiment, known code 
generation and compilation techniques are used to recursively descend through the task 
and interval graphs to produce machine code for executing the program on the multiple 
processors. Furthermore, well-known techniques such as profiling the original code or 
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instruction-level simulation can be used to measure the efficiency of the mapping with 
various metrics. For example, one metric for measuring the efficiency of the mapping is 
the utilization of the processors in the architecture. 

Equivalents 

[0072] While the invention has been particularly shown and described with reference 
to specific embodiments, it should be understood by those skilled in the art that various 
changes in form and detail may be made therein without departing from the spirit and 
scope of the invention. 

[0073] What is claimed is: 
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